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^''Method for processing an image acquired by means of a 
guide consisting of a plurality of optical fibres." 

The present invention relates to a method for 
processing an image acquired by means of a guide 
consisting of a plurality of optical fibres. It finds a 
particularly advantageous application in the field of 
medical imaging. However the invention has a broader 
scope because it can apply to any field in which imaging 
is carried out by means of a guide consisting of a 
plurality of optical fibres. The image guide allows an 
image to be obtained. Such an apparatus allows the laser 
scanning and the light source and the receiver to be 
shifted well away from the object which is to be 
observed. For example in a laser scanning system in 
which a confocal image is obtained, the image guide is 
an assembly of several thousand optical fibres whose 
spatial arrangement is identical at the entrance and at 
the exit. The observation of an object through this 
guide could be compared to an observation via a grid, 
because of the loss of information between the optical 
fibres. The display is therefore hampered because of the 
presence of the optical fibres: the pattern of the 
optical fibres appears on the acquired image. This 
necessitates specific processing so as to eliminate this 
pattern and improve the readability of the image. 

In current systems, this specific processing is 
limited to a linear filtering of the acquired image. 

The present invention aims to propose a new method 
allowing the images acquired by means of an optical 
multi-fibres guide to be rendered readable. 

Another aim of the invention is to take into 
account the parasite effects due to the acquisition 
apparatus in the processing of the acquired image. 

At least one of the above-mentioned objectives is 
achieved with a new method for processing an image 
acquired by means of a guide made up of a plurality of 
optical fibres. According to the invention, for each 
optical fibre, a zone corresponding to this optical 
fibre is isolated on the acquired image. 
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each zone is locally processed individually, then the 
acquired image is reconstructed eliminating the pattern 
due to the optical fibres. 

With the method according to the invention, the 
5 isolation of the optical fibres on the image comes down 
to the isolation on the image of the zone corresponding 
to each fibre. When the pixels representing the majority 
injection in terms of surface (zone of influence) into a 
fibre are isolated, local processing can then be carried 

10 out on each optical fibre. The low crosstalk of the 
guide and settings of the injection make it possible to 
guarantee that the information content of each fibre 
does not depend on the neighbouring fibre but only on 
the spatial coherence of the observed object. The 

15 apparatus carrying out the image acquisition is set so 
as to have enough pixels per fibre: the information 
which is detected by this fibre and which is distributed 
over the pixels representing the optical fibre can thus 
be precisely estimated. 

20 Thus, instead of processing the image globally by 

realizing a simple linear filtering as in the prior art, 
in the method according to the invention each optical 
fibre is isolated on the acquired image and the 
information detected by each optical fibre is processed. 

25 Advantageously, the apparatus carrying out the image 
acquisition is monitored in order to guarantee the 
minimum-efficiency conditions of the method according to 
the invention. For this, the sampling rate, the quality 
of the injection into the optical fibres, and the 

30 setting of the detection chain can be modified in order 
to guarantee an ^^egg box" type profile, in particular on 
the reference image. 

Advantageously, when the optical fibres are 
isolated on the image and when each isolated zone is 

35 processed, numerous applications can be envisaged such 
as : 

reconstruction of an image without the pattern 
of the fibres: the fibres hamper readability and the 
subsequent processing carried out on the image; 
40 - monitoring of the roughness of the surface of 

the guide, the roughness will disturb the injection 
phenomenon, and make it spatially variant; 

re-setting of the images, or the stabilization 
of the image; the pattern of the fibres prevents any re- 
45 setting of the images 



relative to each other, knowledge of the position of the 
fibres and of the observed information allowing the 
images to be aligned; 

- super-resolution: small movements can be used in 
the acquisition of a sequence of images in order to 
resample the images with a smaller spatial period, and 
therefore to obtain a better resolution; 

- quantization of the images: information about the 
image can be extracted much more easily and precisely 
without the pattern of the optical fibres, 

~ the temporal control of the internal parameters 
of the acquisition apparatus: knowledge of the position 
of each fibre and of their optimum injection values 
allows monitoring of the wear on the guide, and the 
variations of certain optoelectronic parameters. 

In the method according to the invention, in order 
to isolate each zone, a mask, corresponding to the 
pattern of the fibres, can be applied to the acquired 
image. This mask, corresponding to an image of the 
related components representing each fibre, is obtained 
during a stage of detecting the fibres from a reference 
image . 

The reference image is an image allowing the 
optical fibres to be well distinguished from each other. 
It may have come from the observation of a mirror, a 
homogeneous scattering medium, a homogeneous fluorescent 
medium, it may also come from the backscattering 
peculiar to the inside of the bundle of optical fibres. 
But it can also be the acquired image. On leaving the 
detection stage, an image of the related components 
(segments) representing each optical fibre is therefore 
obtained. Each grey level represents a single index 
denoting an optical fibre in the guide. 

According to the invention, the stage of detecting 
the fibres can comprise the following stages: 
prefiltering of the reference image, 
segmentation by region, using the ^^watershed'' 
algorithm, named here LPE 

correction of segments having an abnormally 
large surface, and 
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correction of segments having an abnormally 
small surface. 
The two corrections stages are interchangeable, and 
5 they can be carried out in an iterative way. 

Advantageously, the prefiltering stage can comprise 
a morphological opening stage followed by an image- 
inversion stage. The digital morphological opening is 
used in order to seek to eliminate the parasite maxima 
10 situated on the optical fibres. This is a standard 
preprocessing of the LPE ^'watershed'' algorithm carried 
out during the segmentation by regions. 

At output of the prefiltering stage, an image is 
obtained of the optical fibres filtered free of their 
15 local maxima, and smoothed at the interfibre zones. 

The image-inversion stage can be preceded by a 
scalar-type anisotropic scattering stage. 

According to the invention, the prefiltering can 
also comprise a stage during which an interpolation to 
20 the nearest neighbour is carried out in order to double 
the size of the image vertically and horizontally. 

With this interpolation stage, it is sought to 
simulate mathematical morphology structuring elements 
with a radius less than one. The image is doubled so 
25 that the following morphological opening does not affect 
the isolated maxima, but only those which are 8-related, 
but not 4-related (diagonal neighbours) . The benefit is 
a selection of the maxima eliminated by the opening. 

Moreover, in the presence of a plurality of 
30 acquisition images, the prefiltering can also comprise a 
stage of temporal filtering. 

Advantageously, the local processing of each zone 
can consist of calculating the photon flux detected for 
each zone (corresponding to a given fibre) of the 
35 acquired image, and correcting the bias on each thus- 
calculated flux value. 

Preferably, the calculation of the flux is 
calculated using an estimator of maximum likelihood 
calculated on a specific injection profile of each 
40 fibre. More precisely, the maximum likelihood estimator 
can be used on the amplitude distribution of the 
specific injection profile in 
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each optical fibre. The profile is a curve representing 
the injection rate as a function of the distance of the 
light from the centre of the transverse section at the 
end of the optical fibre. This profile is often 
modelized by a Gaussian filtering. 

According to an embodiment of the invention, also 
applying the mask to an image representing a parasite 
background, the photon flux detected for each zone of 
the background image is also calculated, and the flux 
value of each zone of the corresponding background image 
is subtracted from each flux value of each zone of the 
acquired image and the bias correction is carried out on 
the result of this subtraction. 

The background image can be parasite reflections on 
the optical systems of the acquisition apparatus, thus 
including those at the exit of the image guide, but it 
can also be the offset, the electronic noise, of the 
digitizing chain of the acquisition apparatus. If the 
offset is dominant on the image, the background cannot 
be obtained by simply removing the image, because the 
offset depends on the content, and is therefore no 
longer the same. In this case, a quantile of the 
histogram is used to estimate it. The histogram is that 
of the image acquired during the real-time measurement 
and that of an adjustment image during an adjustment 
stage as will be seen below. 

The parasite background can come from the 
background image or from an offset of the detection 
chain . 

According to the invention, the bias correction can 
consist of the spatial . separation of the fibres into 
different blocks, the estimation of the bias value in 
each block, the interpolation of the bias values so as 
to obtain a bias value for each fibre, and the division, 
for each zone, of the flux value obtained in the 
preceding stage by the thus-obtained value for 
corresponding bias. 

The reconstruction of the acquired image can 
involve a calibration stage in order to calibrate the 
flux of the acquired image, after local processing, and 
a mosaic reconstruction stage. Other types of 
reconstruction can be used, such as by interpolation or 
with bases of radial functions. 
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Moreover, the present invention can be implemented 
without the adjustment and calibration stages. In this 
case, the reference image can be the acquired image. 
5 For the calibration and for each zone of the 

acquired image, the flux value obtained after local 
processing can be divided by a flux value obtained 
following an adjustment stage. This division operation 
allows compensation for the wrong injections into some 
10 optical fibres. 

According to an advantageous characteristic of the 
invention, the adjustment stage consists of: 

- isolating each zone of an adjustment image by 
applying the mask, corresponding to the pattern 

15 of the fibres, to this adjustment image, 

- calculating the photon flux detected for each 
zone of the adjustment image, and 

- correcting the bias on each thus-calculated flux 
value . 

20 The image obtained upon completion of the 

adjustment can serve as a standard for the acquired 
image so as to obtain an acquired image for which all of 
the optical fibres of the guide would have been injected 
in the same way. 

25 Preferably, the flux is calculated using an 

estimator of maximum likelihood calculated on the 
specific injection profile of each fibre. Moreover, also 
applying the mask to an image representing a parasite 
background, the photon flux detected for each zone of 

30 the background image can be calculated, the flux value 
of each zone of the corresponding background image can 
be subtracted from each flux value of each zone of the 
adjustment image, and the bias correction can be carried 
out on the result of this subtraction. 

35 In other words, during the adjustment stage, the 

same operations are carried out as during the 
measurement, i.e. during the processing of an image 
acquired in real time. Except that, for the adjustment 
an adjustment image is used which broadly shows the 

40 pattern of the optical fibres. The adjustment allows, 
after detection of the fibres on the reference image, 
the generation of an image in which the injection rate 
will serve as a standard during the . real-time 
measurement. During the measurement, 

45 
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the injection rate is also corrected on the acquired 
image, and the observed flux is calibrated as a function 
of the standard image so as to reconstruct an acquired 
image without the pattern of the optical fibres. 
5 By bias is meant a low-frequency component, this 

component being able to result from various causes. 

The bias correction can be carried out during the 
adjustment and during the real-time measurement. In the 
first case, this can be because the adjustment takes 

10 place for example on a plane mirror, and because the 
field curvature will reduce the injection quality upon 
the return to the edges (which are out of focus) . On the 
measurement object, or in a homogeneous scattering 
mediiam, the injection remains less satisfactory on the 

15 edges, and this manifests itself in a bias which is 
similar to the first as regards its form. The bias can 
also be caused by a vignetting problem. Generally, the 
bias has an almost circular symmetry. The bias is 
actually estimated by dividing the image into N x N 

20 blocks of fixed size, then estimating the bias on each 
block. For this it is necessary to consider the nature 
of the observed object. In the case of a homogeneous 
object, the bias can be acquired by taking the average 
or median value over the block. When there is an object, 

25 it is necessary to know whether this object is darker or 
lighter than the rest of the image. By way of example, 
the bias can be multiplicative, and therefore an average 
or median operator is more likely taken (compared to a 
maximum or minimum for an additive bias) . Thus an image 

30 measuring N x N is obtained which is used, after 
interpolation, to find the bias value seen by each 
fibre. A bilinear interpolation can be used for example. 

The mosaic reconstruction can consist of 
distributing, over the whole surface of each zone of the 

35 acquired image, the flux value of each zone obtained 
following the calibration stage. Then a low-pass 
recursive filtering can be carried out so as to smooth 
the reconstructed acquired image. 

According to an advantageous embodiment of the 

40 invention, the reference image and the adjustment image 
are identical. 

Other advantages and characteristics of the 
invention will become apparent when examining the 
detailed description of an embodiment which is in no way 

45 limitative, and the attached drawings, in which: 
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Figure 1 is a global schematic view of the 
image-processing method according to the 
invention; 

Figure 2 is an flow chart detailing the main 
stages of an adjustment method according to the 
inventions- 
Figure 3 is an flow chart detailing the main 
stages of a measurement method according to the 
invention; and 

Figure 4 is an flow chart detailing the final 
stages taking into account the adjustment and 
measurement methods for the reconstruction of an 
acquired image without visible optical fibres 
according to the invention. 
In Figure 1 a global diagram of the method 
according to the invention is represented. 

The method can be divided into four parts: a part 1 
relating to the detection of the fibres, an adjustment 
part 2, a measurement part 3, and a reconstruction part 
4. Parts 1 and 2 correspond to the diagram of Figure 2, 
while part 3 corresponds to the diagram of Figure 3 and 
part 4 corresponds to the diagram of Figure 4. 

In Figure 1, according to the invention, when it is 
wished to acquire a series of images, an adjustment 
stage is carried out first of all. For this, a reference 
image 5 is considered which is subjected to a stage of 
detecting the fibres 6 so as to obtain an image 7 of the 
related components representing each fibre. The 
reference image 5 is an image acquired by means of a 
system comprising a guide constituted by a plurality of 
optical fibres, for example from 10 000 to 30 000. The 
reference image 5 is obtained such that the pattern of 
the optical fibres is distinguished, i.e. of the ^^egg 
box" type: on the profile of the image, a fibre which 
manifests itself in a small mountain surrounded by a col 
and a valley. The reference image 5 undergoes an 
operation of detecting the fibres so as to obtain a sort 
of mask representing the pattern of the optical fibres. 
This mask is the image of the related components 
representing each fibre. Each grey level represents a 
single index denoting an optical fibre in the guide. 
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The image 7 is then used for the adjustment 2 of 
the image acquisition system. The adjustment aims" to 
determine an image of the fibre-by-fibre photons 
5 injection rates. This adjustment stage is necessary in 
so far as each fibre has slightly different physical 
properties from the other fibres. There is thus a 
certain disparity regarding the ability of each optical 
fibre to convey the same photon flux. 

10 In order to carry out the adjustment 2, an image 8 

is considered^ hereafter called mirror image, obtained 
by placing the mirror in front of the optical system of 
the image guide. This image can also be that of a 
homogeneous scattering medium, a homogeneous fluorescent 

15 medium or of the backscattering peculiar to the interior 
of the bundle of optical fibres. This image 8 can also 
be the same image as is used in 5, i.e. the reference 
image. The mask 7 is used to determine the photon flux 
of the mirror image 8 seen by each optical fibre during 

20 stage 9. Optionally, the photon flux seen by each fibre 
during stage 11 can also be determined for a parasite 
background image 10. This image 10 can correspond to 
parasite reflections on the optics of the acquisition 
system, but also to the offset and/or the electronic 

25 noise due to the digitizing chain of the acquisition 
system. The flux calculation of stage 11 also involves 
the mask 7 so as to identify the zone corresponding to 
each fibre. In stage 12, for each optical fibre, the 
photon value of the mirror image 8 is subtracted by the 

30 photon flux value of the background image 10. In stage 
13 it is estimated that, for each optical fibre, the 
difference obtained in stage 12 corresponds to the 
standard injection rate for each fibre (stage 13) . 

In stage 14, a bias correction is carried out on 

35 the image of stage 13. The image resulting from stage 14 
is therefore an image presenting, for each zone 
corresponding to an optical fibre, a standard and 
corrected photon flux value. This image resulting from 
stage 14 will serve as a reference for a series of 

40 images acquired in real time by the acquisition system. 
The images acquired and processed in real time undergo 
the processing illustrated in parts 3 and 4. 
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The measurement part 3 receives an acquired image 
15, typically the image of a measurement object. As 
realized in the adjustment part 2, the photon flux seen 
5 by each fibre is also calculated here in stage 18 as 
regards the acquired image 15. For this, the mask 7 is 
used so as to identify, on the acquired image 15, the 
zone corresponding to each optical fibre. Optionally, a 
parasite background image 16 is considered as 

10 previously, which can be a real image, i.e. 
corresponding to the background of the acquired image 
15, or an estimated image corresponding to the noise of 
the acquisition system. This background image 16 also 
undergoes a stage 17 using the mask 7 so as to determine 

15 the photon flux seen by each fibre. In stage 19 a 
subtraction is carried out. The result of the 
subtraction is an image presenting, for each zone 
corresponding to a given optical fibre, a useable photon 
flux. Stage 21 is an optional stage during which a bias 

20 correction is carried out on the image 20. 

The reconstruction part 4 receives on the one hand 
the corrected image 20 and on the other hand the 
corrected (debiased) image 13 so as to carry out a 
calibration operation 22, dividing the flux of the 

25 observed object (element resulting from stage 21) by the 
standard fluxes (element resulting from stage 14). In 
stage 22 a reconstruction is also carried out so as to 
obtain a reconstructed image 23 without a pattern of the 
visible optical fibres. 

30 In Figure 2 the method 1 of detecting the fibres 

and the adjustment method 2 are seen in more detail. The 
operation 6 of detecting the fibres involves four 
operations : 

a pref iltering, 

35 - a LPE ^Vatershed'' corresponding to a 

segmentation by region; 

a correction of the segments having an 
abnormally large surface; and 

a correction of the segments having an 
40 abnormally small surface. 

The two correction operations are interchangeable, 
and they can also be carried out in a loop. 

The prefiltering operation 61 receives the 
reference image 5 at the entry and generates an image of 
45 the fibres filtered free of these local maxima 
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and smoothed at the interfibre zones. The prefiltering 
involves a morphological opening operation, optionally 
followed by a scalar-type anisotropic scattering, then 
by an inversion of the image. When there are several 
5 images of the same fixed object, a temporal filtering of 
the images can be carried out. An interpolation to the 
nearest neighbour can also be carried out in order to 
double the size of the image vertically and 
horizontally. 

10 The image generated by the prefiltering 61 then 

undergoes a watershed operation 62, allowing an image to 
be obtained from the related components of the detected 
fibres. The watershed operation, of the conventional 
type, will allow segments located at the edge of the 

15 image to be marked so as to remove them from the final 
result. The characteristics of these obtained segments 
(average size, standard deviation, proximity) are then 
calculated. The image resulting from the operation 62 
will undergo two successive corrections 63 and 64. The 

20 operation 63 is a correction of the segments having an 
abnormally large surface- For this, the segments which 
are both too large relative to an average size and have 
too many neighbours relative to a normal surface of the 
fibres are selected. These segments are resegmented with 

25 a watershed either on the original image or on a 
distance card image inside the detected segments (in a 
segment, distance between each pixel and the edge of the 
segment) . The characteristics of the obtained segments 
(average size, standard deviation of the sizes) are then 

30 calculated. 

In stage 64, the segments having an abnormally 
small surface are corrected. The adjacency graph of 
segments is also calculated, then it is decided which 
fibres must be fused and which are just candidates. In 

35 every case, the set of possible fusions is the set of 
fusions with each neighbour. For the fibres which must 
be fused, the possible fusion is taken which gives the 
smallest density value. For the others which are only 
candidates, three filters are used successively to 

40 eliminate the fusions which produce wrong results. The 
first filter checks that the size after fusion is not 
too large. The second filter checks that the density 
after fusion does not 
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exceed a maximum value. The last filter checks that the 
fusion improves density. If several fusions remain, 
those are retained which produce a better density result 
(the smallest) . Once all the fusions have been carried 
5 out on the adjacency graph, the results are reflected 
onto the image of the related components, at the exit. 
The characteristics of the obtained segments (average 
size, standard deviation of the sizes) are then 
calculated. The second correction 64 allows the 

10 generation of the image of the related components which 
will serve as a mask for the adjustment 2 and the 
measurement 3. 

The right-hand part of Figure . 2 relates to an 
adjustment method 2 as represented in Figure 1 but in a 

15 simplified manner. The optional operations 10 and 11 do 
not appear in Figure 2. 

The masking stage 91 consists of marking, on the 
mirror image 8, the zone or surface corresponding to 
each optical fibre of the guide. The image 7 of the 

20 related components serves as a mask. In stage 92, the 
flux coming from the observed object is calculated for 
each optical fibre. The flux is calculated using the 
estimator of the maximum likelihood determined on the 
specific injection profile of each optical fibre. In 

25 stage 14, a bias correction is carried out as will be 
seen in more detail in Figure 3. At output of stage 14, 
a standard value of the photons injection rate is 
obtained in stage 24 for each optical fibre. 

Figure 3 shows, the measurement method according to 

30 the invention. This method takes place in real time. On 
the acquired image 15, the zone corresponding to each 
optical fibre is marked by carrying out a masking 
operation 181 using the mask 7. In stage 182, the flux 
coming from the observed object is then calculated for 

35 each fibre. As previously, the calculation is carried 
out using the estimator of the maximum likelihood 
determined on the specific injection profile of each 
optical fibre. The same operations of masking 171 and 
flux calculation 172 are carried out on a parasite 

4 0 background image 16. 

In stage 19, for each zone corresponding to an 
optical fibre, the background flux (172) is subtracted 
from the flux of the acquired image (182) . 



If. the background image is not supplied and this 
background exists, it must be subtracted, an offset 
and/or electronic noise of the measurement system being 
calculated using a quantile on the histogram of the 
acquired image 15. 

Then in stage 21 a bias correction can be carried 
out on the image resulting from the subtraction 19. In 
this case, in stage 211 the zones corresponding to the 
fibres are spatially separated into different blocks. In 
stage 212, the bias value is calculated in each of these 
blocks using a given operator. Then in stage 213, the 
bias values are interpolated in order to obtain a value 
for each fibre. Then in stage 214 the flux value seen by 
each fibre is divided by the value of the bias obtained. 

At the end of stage 21, an image 25 is. generated 
representing the flux observed for each fibre. 

The final reconstruction stage takes into account 
the image of the standard injection rate 24 and the 
image of the observed flux 25. The calibration operation 
aims to compensate for the injection losses by 
equalizing the injection rate of all the optical fibres 
so as to have an image all the fibres of which have been 
injected in the same way. For this, in stage 221 the 
observed image flux 25 is divided by the image of the 
injection rate 24. 

A mosaic reconstruction is then carried out by 
distr3_buting, in stage 222, over the whole of the 
surface corresponding to each fibre, the value obtained 
after calibration (division) . In order to produce a more 
regular appearance, a Gaussian low-pass filtering 223 
can be carried out for example. 

Of course, the invention is not limited to the 
examples which have just been described and numerous 
changes can be made to these examples without going 
beyond the scope of the invention. 



